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ABSTRACT 

Using a system that monitors just thb process of 
education does not guarantee positive student outcomes. What 
education needs is a consistent set of accountability procedures for 
all students. As educators take steps toward a new and inclusive 
accountability system, they need to look at: (1) possible alternative 
approaches to accountability; (2) data needed to demonstrate that 
education is working for students with disabilities; and (3) barriers 
to the collection of these data and ways to overcome these barriers. 
Alternative approaches to accountability may include: focus on 
results or outcomes , collect information on achievement of 
Individualized Education Program objectives, analyze extant data, use 
norm-referenced tests, and create accreditation programs. Data needed 
include input, process, and outcome data. Barriers to collecting data 
include, among others, competing attitudes, lack of commitment, lack 
of agreement on outcomes and standards, and lack of curriculum-test 
alignment. Overcoming barriers involves offering staff development, 
involving stakeholders, mandating collection of accountability data, 
and other activities. (JDD) 
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Educational Accountability for 
Students With Disabilities 



► 



Background 



There is a new buzz word in cur- 
rent discussions about educational . 
reform: Accountability. It's being 
defined as the use of systematic 
methods to demonstrate to indi- 
viduals, inside and outside of the 
education system, that schools are - 
moving in desired directions. • * 
Policymakers, school administra- 
tors, and the general public have 
joined in the debate. They want to 
know: Is education in the U.S. pro- 
ducing the results it shouldj 

Because documenting educational 
effectiveness has been addressed 
from the local school level to the 
national level, many different 
accountability practices have been 
created. That is, for most stu- 
dents...until recently. 

For students with disabilities, dis- 
cussions about accountability have 
been restricted to "process/ 7 This 
means that special education has 
focused on child count informa- 
tion: How many students, and 
with which disabilities, are on 



Individualized Education 
Programs (IEPs)? Where do these 
students receive services? Are the 
proper procedures followed in 
identifying students with 
disabilities? 

The child count and compliance 
data do not demonstrate that stu- 
dents are achieving desired 
results. And, using a system that 
monitors the process of education 
does not guarantee positive stu- 
•dent outcomes. What education 
needs is a consistent set of 
accountability procedures for all 
students. 

As educators take steps toward a 
new and inclusive accountability 
system, they need to look at: 
1* Possible alternative 
approaches to accountability 
2. Data needed to demonstrate 
that education fs working for 
students with disabilities 
3* Barriers to the collection of 
these data* 

Armed with this information, edu- 
cators can find ways to overcome 
barriers to implementing new 
forms of accountability. 
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Alternative 
Approaches 



There aie a number of alternative 
approaches that could indicate the 
degree to which education is 
working for students, including 
students with disabilities. Many of 
the following options seejc to rec- 
ognize student progress rather^ 
than monitor the educational 
process. 

• Focus on results or outcomes 

States, local school districts, or 
schools specify desired criteria for 
achievement through outcomes- 
based assessments. 

• Collect IEP information * 

Educators document students' 
achievement of IEP objectives. 
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• Analyze extant data 
Educators look at existing data to 
provide information on the effec- 
tiveness of specific programs for ■ 
&cudents with disabilities. 

S Use norm-referenced tests 
Teachers give students tests like 
the Iowa Test of Basic Skills to 
measure their achievement; results 
from many, students are combined 
to produce school- or district-level 
results. 

• Create accreditation programs 
States distnoute rewards and sanc- 
tions, report student progress, 
and /or provide public recognition 
of good programs. 

Some of these alternatives to child 
count are more effective than oth- 
ers at including all students. For 
example, students with disabilities 



have historically been excluded 
from participating in norm-refer- 
enced tests. Greater promise may 
exist in programs that focus on 
results or outcomes by using per- 
formance assessments. 

Data Needed 

When establishing*an accountabil- 
ity system, first agree on what 
types of data are most useful and 
available for documenting the 
progress of education. Most 
accountability programs that 
include students with disabilities 
collect input, process, and out- 
come data. 

Collecting input and process data 
provides information on the con- 
texts in which children learn. 



However, this information should * 
only supplement cfcta collected on 
student outcomes. See the chart on 
this page for possible types of data 
to collect. „ 

► Barriers to 
Collecting Data 

Some of the issues encountered in 
collecting accountability data pose 
general challenges, while others 
become barriers to facilitating the 
participation of students with* dis- 
abilities in assessment programs. 
But there is one over-riding issue 
that will influence the resolution 
of all of the other barriers to col- 
lecting accountability data: com- 
peting attitudes. This includes the 
attitudes of educators, policymak- 
ers, parents, and students. 



Possible Types of Data to Collect 



• Input Data help to plan future budgets, identify the cost efficiency of certain programs, and indicate the 
needs of groups of students. 

. 1. Program Resources (staff, instruction, and other resources allotted to each child) 
2. Student Characteristics (student mobility, number receiving free/ reduced lunch) 

• Process Data include information on the type and quality of, and access to certain programs. 

1. Opportunity to Learn 

2. Inclusion of Students with Disabilities in General Education 

3. Teacher Expectations for Individual Pupil Performance 

4. Extent to which IEPs Translate into Instruction 

• Outcomes Data contain*the most crucial information for making decisions about whether education is 
working for students. 

1. Academic and Functional Skills 

2. Valued Socir and Emotional Outcomes 

3. Generalization of School Learning to Everyday Life 

4. Student r.nd Parent Satisfaction 

5. Independent Living 

b. Community Participation 

7. Extent to Which the "Product" of Schools Meets the Needs of the Labor Market 



Ddta that Administrators Need to Demonstrate that Education Works tor Students witn Disaomties 
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Issues Encountered 



! Competing Attitudes 

Commitment 

Worth?, Fear, and Control 

Role of the State 

Sanctions and Rewards 

Responsibility for Student 
Learning 

j Inclusion in Assessment 

| Nongraded Classrooms 

Agreeing on Outcomes and 
Standards 

i Curriculum-Test Alignment 

Measuring Complex Skills 

What and How to Report the 
Information 

Perception that Data Have 
No Utility 



► Stakeholder Commitment and 
Mistrust v 

Stakeholders may not be ready to 
commit to accounting for the 
results of education or collection 
of data. They might be concerned 
that a shift of resources from direct 
service to data collection would 
cause educators and the public to 
become skeptical. They might ask: 
Is it worth it? Or, they may be 
fearful that an accountability pro- 
gram would cause them to lose 
local control. 

Educational reform can sometimes 
foster mistrust among stakehold- 
ers. The role of the state needs to 
be determined without increasing 
stakeholder fear of losing local 



control. Decide whether the state's 
role should be a top-down or a 
bottom-up approach to collecting 
accountability data. This can have , 
a big impact. For example, if the 
state decides to mandate an 
assessment in order to facilitate 
data aggregation, the instruction 
and testing decisions in local 
schools will be affected. 

► Educator Responsibility 

Some educators may be reluctant 
to be held responsible for the edur 
cational gains of students with dis- 
abilities or low performing stu- 
dents, especially if sanctions and 
rewards are steep. But the fact is, 
students^with disabilities now 
spend more time in general educa- 
tiQn than special education. 
Responsibility for student learn- 
ing should reflect the multiple 
contexts in which students are % 
being educated. But, this is easier 
said than done. 

Collecting accountability data on 
how well students with disabilities 
perform also poses a challenge. 
Often,, these students have not 
experienced inclusion in tradi- 
tional assessments. The practice 
of collecting data on some but not 
all students has led to sorting and 
ranking. Equitable policy deci- 
sions and fair comparisons 
between schools, districts, and 
states require that data collection 
* be systematic and accurately rep- 
resent the educational needs and 
accomplishments of all students, 
not just general education 
students. 

Common reasons for educators to 
exclude students with disabilities 
~in testing programs are: 



• The outcomes or standards are 
inappropriate for some students : • 
with disabilities. * 

• The accommodations needed as 
a result of the student's disability 
are unavailable or invalidate the 
test I i^Z! . 

• Some students with disabilities 
may be in nongraded classrooms, 
making it difficult to determine 
inclusion. * ...... 

As educators move ^eyond the 
issue of,inclusion, agreeing on 
outcomes and standards becomes 
the next controversial issue. To * 
reach consensus among all stake- 
holders, they must define out- 
comes that are important for all 
students without lowering the 
standards; balance post-school 
transition and academic outcomes; 
and set quality outcomes and stan- 
dards that are congruent with 
those of other states* 

^ Using Assessments to Measure 
and Report Data 

Education mu$t provide all stu- 
dents with the opportunity to 
learn the skills necessary to 
achieve the set standards. 
Assessments should reflect what 
these students are^learning in the 
classroom. To moniior whether 
this is happening, states use cur- . 
•riculum-test alignment. 

^It is possible that states could 
decide to first administer assess- 
ments that reflect state outcomes 
and then expect curriculum 
adjustments to follow. Or states 
could modify the curriculum first 
and then develop assessments that 
are instructionally relevant and 
sensitive to the change. But, lately 
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the issue of assessments has 
beome more complex. As educa- 
tors attempt to document higher- 
order skills such as'creativity, 
synthesis, and interpersonal skills, 
they are finding less agreement on 
how to measure complex skills. 

Once assessments are adminis- 
tered, what information should 
be reported and how should it be 
reported? States need to be able to 
not only identify students with 
disabilities in large data sets, but 
also .to: 

• Report on their performance 
t # Document the number of stu- 
dents with disabilities who do 
not participate in the assess- 
ment program 

• Report results together with, 
or separate from, those of gener- 
al education students. 

When an accountability program 
is in place, developers, partici- 
pants, and consumers may be con- 
cerned that there is no utility to 
the program. There is a risk that 
no one will understand or benefit 
from the information presented, 
particularly if a lot of contextual 
data are included. The utility of an 
accountability program rests on its 
ability to use the data to promote 
positive educational reform. 

► Overcoming 
Barriers 

To overcome barriers in establish - 
ing new forms of accountability 
systems, choose options that con- 
sider the state's role. There are a 
number of strategies, but staff 
development and stakeholder 
involvement are crucial to 
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implementing a successful 
accountability program. 

► Essential Strategies 

Offering staft development 

increases stakeholders' knowledge 
of and reduces the fear of account- 
ability systems. Those fears often 
come from a lack of technical 
knowledge about the systems and 
how to implement them. 

Invplving stakeholders up front 
decreases the fear of losing local * 
control. It also increases the likeli- 
hood that the program will build 
upon pre-existing local account- • 
ability structures and will include 
instructionally relevant and intelli- 
gible data on outcomes that are 
important to parents, advocates, 
teachers, employers, and students. 

► State Mandates and Guidelines 

Another strategy is for states to 
mandate the collection of 



accountability data on all students. 
States must be prepared to enforce 
the policy and to provide pro- 
grams that offer the technical sup- 
port necessary to ensure success. 
If state*, develop guidelines for 
assessment accommodations and 
participation in assessments, they 
can help overcome barriers tc 
implementing accountability sys- 
tems. But, this will happen only if 
they include students with disabil- 
ities in testing. 

To increase the participation of 
students with disabilities, states 
need to develop outcomes that are 
comprehensive and broad enough 
to be meaningful for all students. 
Progress toward achieving the 
outcomes may be monitored via a 
state data base that allows out- 
comes and contextual data to be. 
stored and analyzed. The data 
base must be set up to allow sepa- 
rating out assessment data for 
students with disabilities, a capa- 
bility needed to examine the 



What to Consider in Overcoming Barriers 



Offer Staff Development 

Get Stakeholders Involved Up Front 

Mandate Collection,of Accountability Data 

Develop State Guidelines on Inclusion and on Accommodation 

Build a Comprehensive State Data Base 

Gain Consensus on Outcomes 

Include Students With Disabilities in Testing 

Disaggregate Data 

Hold Systems Accountable for Creating an Environment in Which 
Students Can and Will Learn * 

Provide Incentives 

Accredit Local School Systems 

Learn from Other States 
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effectiveness of special.education 
and other programs. 

State mandates are preferable to 
possible federal mandates or 
* rewards and sanctions as part of 
special education funding. States 
also need to be aware that direct 
federal involvement may meet 
resistance because: 

# Allocating resources.based 
upon students meeting state 
standards will be viewed as a 
disservice to programs serving 
students with disabilities; 

# It is unlikely that the federal 
government could effectively 
and efficiently regulate the 
progress of students with dis- 
abilities toward standards; and 

# The division between special 
and regular education might be 
perpetuated. 

^ Achieving Success 

Success depends on being able to 
provide a system that creates an 
environment in which all students 
can antf. will learn. This requires 
greater participation on the part of 
educators. Any resistance could be 
overcome by providing incentives 
such as more focused technical 
assistance, or accreditation for 
1 schools that facilitate the progress 
of their students toward state 
outcomes. 

A successful, yet simple strategy 
to overcome barriers is to learn 
from past efforts. Those develop- 
ing and implementing account- 
ability programs can benefit from 
ideas and examples of effective 
programs used by other states. 
NCEO's report, Implementation of 
' Alterna tive Methods for Making 
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Educational Accountability Decisions 
for Students with Disabilities, sum- . 
marizes and provides concrete 
examples of six states' approaches 
to accountability. 

Recommendations 

• Create an accountability pro- 
gram that holds systems responsi- 
ble for providing environments in 
which students can and will learn. 
Such a program would rely on 
studfent outcomes rather than 
child count data. 

• Look at NCEO's Self-Study 
Guide to the Development x)f 
Educational Outcomes and Indicators 
to help develop and gather sup- 
port for targeted student out- 
comes. 

• Give careful thought to creating 
incentives for people to change the 
ways in which they gather data on 
identified student outcomes. 
These incentives may be in the 
form of sanctions and rewards, 
added technical support, or 
special reports on the data. % 

• Make certain that the data col- 
lection program makes sense to 
t^ose who implement it. Thus, 
stakeholder involvement an'd buy- 
in up front is critical. 

• Provide resources for teacher 
training, but do not invent new 
data collection activities. Data that 
are used will make more sense to 
those who collect them. This may 
include reporting data separately 

1 to indicate the effectiveness of spe- 
cial programs. 

. • Make sure all levels*of account- 
ability profess an attitude 
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supporting the need for account- 
ability and a commitment to data 
collection. 

► Further 
Information 

Implementation of Alternative 
Methods for Making Educational 
Accountability Decisions for 
Students with Disabilities * 
(Synthesis Report 12). Ysseldyke, 
J.E., Thurlow, M. L. & Geenen, 
K.M. (1994). Minneapolis, MN: 
National Center on Educational 
Outcomes. 

Issues and Options ittQutcomes- 
Based Accountability for Students 
with Disabilities. Center for 
Policy Options (1994). College 
Park, MD: Author. 

Opportunity-to-Learn Standards 
(Synthesis Report 14) .Ysseldyke, J. 
E., Thurlow, M. L., & Shin, H. 
(1994). Minneapolis, MN: National 
Center on Educational Outcomes 

Views on Inclusion and Testing 
Accommodations for Students 
with Disabilities. Ysseldyke, J.E., 
& Thurlow, M. L. eds. (1993). 
Minneapolis, MN: National Center 
on Educational Outcomes. 

NOTE: This document was prepared 
with input from participants in a 
meeting of selected state personnel 
held in Chicago in September 1993. 
Representatives from the follovnng 
states participated in this meeting: 
Illinois, Iowa, Kentucky, Maryland, 
Michigan, and West Virginia. Some 
of the ideas reflected in this document 
are based also on discussion at a 
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special forum on educational evalua- 
tion sponsored by the National 
Association of State Directors of 
Special Education in August 1993, ▲ 
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The National Center on 
Educational Outcomes (NCEO), 
established in' 1990, works with 
state departments of education, 
national policy-making groups, 
and others to facilitate and enrich 
the development and use of indi- 
cators of educational outcomes for 
students with disabilities. It is 
believed that responsible use of 
such indicators will enable stu- 
dents with disabilities to achieve 
better results from their education- 
al experiences. , 

The Center represents a collabora- 
tive effort of the University of 
Minnesota, the National 
• Associatioh of State Directors of 
Special Education, and St. Cloud 
State University. 

The Center is supported through a 
Cooperative Agreement with the 
U.S. Department of Education, 
Office of Special Education 
Programs (H159C00004). Opinions 
or points of view do not necessari- 
ly repi osent those of the U.S. 
Department of Education or 
Offices within it. 
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